Minimum Energy-Surface Required by Quantum Memory Devices 
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We address the question what physical resources are required and sufficient to store classical 
information. While there is no lower bound on the required energy or space to store information, 
we find that there is a nonzero lower bound for the product P = {E){r^) of these two resources. 
Specifically, we prove that any physical system of mass m and d degrees of freedom that stores S bits 
of information will have lower bound on the product P that is proportional to /m{exp{S / d) — 1)^. 
This result is obtained in a non-relativistic, quantum mechanical setting and it is independent from 
earlier thermodynamical results such as the Bekenstein bound on the entropy of black holes. 



I. INTRODUCTION. 

Although information may seem abstract and elusive, 
it has made a number of surprisingly concrete connec- 
tions to physics. Originally prompted by Maxwell's de- 
mon, the link of information to thermodynamics has been 
made lucid by the works of Bennett and Landauer (see [l| 
for complete coverage). Physicists and computer scien- 
tists alike have come to recognize that information does 
not exist as an independent entity but is encoded in phys- 
ical devices, and, therefore, "Information is physical" has 
become a new mantra Moreover, the technologi- 
cal trend from the last few decades continually has been 
to compress more information in less space [3|. Due to 
Moore's law we sense that we are near the end of the clas- 
sical regime and entering into the quantum regime where 
exciting possibilities and challenges abound. Thus, to un- 
derstand the ultimate limits to information storage based 
on the quantum laws of physics may be of intellectual as 
well as practical significance. In this paper we seek a 
general and robust result concerning information stor- 
age using non-relativistic quantum theory. Abstracting 
away the details of hardware, we compute the absolute 
minimal amount of physical resources required to store 
information, and the result further illustrates its physical 
nature. 

Typically, information is stored by preparing a device 
in a number of different stationary states corresponding 
to different messages. The device is effectively described 
by a mixed state of a certain entropy, and looking at a 
number of simple devices such as particle in a box, har- 
monic oscillator, and the hydrogen atom, we notice an 
interesting interplay among energy, surface area, mass, 
and entropy (see Table H]). Keeping the constituent par- 
ticles' masses the same, one could save on energy or size 



but never both. For instance, the particle-in-a-box model 
requires the same amount of space regardless of the num- 
ber of states used in the encoding but the energy increases 
with the number of states. The hydrogen atom is an ex- 
ample of the opposite extreme. There is an infinite num- 
ber of states in a finite energy window, roughly equal to 
13.6 eV, but the spatial size of the orbitals increases with- 
out bound. However, if we could change the mass, then 
both energy and space can be reduced arbitrarily. Since 
a number of variables could affect the cost, it is necessary 
to hone in on a precise notion of the cost of information 
storage. We will do so in the next section and determine 
the optimal device based on a number of clearly stated 
plausible hypotheses. Then, we proceed to compute the 
minimum cost and prove a lemma which is needed in 
the calculation. Our main result is a Heisenberg-like un- 
certainty principle governing energy, space, and entropy. 
We conclude with a comparison to rough estimates ex- 
isting in the literature as well as some thoughts upon its 
implications for future technological advances. 



II. DEFINITION OF COST 

Consider storing information in a device described by 
the Hamiltonian 



dcv 



2m ^-^ ax- 

i=l 



(1) 



by preparing it in a stationary (energy eigenstate) "^fa 
with probability Pa- The amount of information thus 
encoded is 



5* = -^Pq logpo 



(2) 
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and the device will be in the state 



(3) 
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System Energy ^^j-g^ Product 



Particle of mass m in ^2^2 , 
a Id box of width L mL^ \ ' 



Harmonic oscillator 

of mass m and 
natural frequency cj 

Electronic states of 
Hydrogen atom 



^(^) ^{n)' 



TABLE I: A system is prepared in different stationary states, 
labelled by n, according to a probability distribution whose 
Shannon entropy is the desired amount of encoded informa- 
tion. Quoted are order-of-magnitude estimates of the average 
energy and surface area, denoted by (•), for a number of sim- 
ple systems 4]. Averages such as (n), {ri^), and (n*) grow 
with increasing entropy. Therefore, although energy and sur- 
face area show different behaviours for different systems, their 
products invariably grow with entropy. 



We consider the average energy and size associated with 
such a mixed state the cost in physical resources required 
by the device. More specifically, let Tr pdcv^^ be the mea- 
sure of spatial cost where 



1=1 



(4) 



To prevent arbitrary shifts due to displacements of the 
coordinate origin, we require for all i € {1, . . . , d} that 
Trpdcva;i = 0. Moreover, let Trpdov-f^dov be a measure of 
the cost in energy, and similarly, to prevent meaningless 
shifts in the Hamiltonian, we require the ground state 
(g.s.) energy to be zero, 



dcv/g.s. 



= 



(5) 



The cost of information storage specific to using H^cv is 
the joint product of energy and space 



Cdov := min Tr pdcvi?dcv Tr pdov?" 

Pdov 



(6) 



subject to the constraint of Equation Since the cost 
in Equation ^ is specific to a device, to find the cost 
of information storage we need to minimize over all de- 
vices having the same number of degrees of freedom and 
particles' mass as follows: 



P := min Cdo 

V{x) 



(7) 



over potentials that satisfy ([5]). 

We choose to express the intuitive notion of cost in en- 
ergy and space by considering linear power in energy and 
quadratic in length, ([5]). One could potentially capture 
the same intuition through other powers of the average 



H and r such as {H'^^){r^^). Putting the exponents in- 
side or outside of the average may change the end result 
slightly but should convey the same physics. Since the 
only dimensionful parameters in our problem are H and 
TO, if the cost is measured in units of J^^ l''^ , where J and 
I stand for Joules and meters, then the answer must be 
expressed in powers ti of h and t2 of m such that 



(8) 



where s and kg stand for seconds and kilograms. Solving 
this equation leads to these constraints on the exponents: 
ti — 2si, t2 — — si, and S2 — 2si. The first two equations 
guarantee that other powers of energy and space admit 
a solution and therefore are also valid, but, as implied 
by the last equation, they all are powers of the basic 
combination of linear in energy and quadratic in space. 



III. OPTIMAL POTENTIAL 

For the purpose of computing a lower bound of P, we 
can relax the condition that the mixed state be diago- 
nal in the eigenstates of i?dev and consider instead the 
following functional of V{x) 

C[Vix)] := min {Tr pHdc. Tr pr^ } , (9) 
p 

minimized over all density matrices satisfying the entropy 
condition 



S = — Tr p log p. 
Obviously, for a given V{x), 

Cdev > C[V{X)] 

Hence, 

P > mmC\V(x)] 

V(x) 



(10) 

(11) 
(12) 



with V{x) subject to the same constraint of Equation ([S]). 
Let us start by observing that C[F(a?)] is rotationally 
invariant. Under a coordinate rotation y = Rx, with 
R e SO{d), we have 



C[V{Rx)] 



min < Tr p 

P 



(13) 



2m 



E^ + ^(^^)lTrp'^'^ (14) 



"^rl^'p ^ + ^^^^ ' ^ ^^^^ 



= C[Vix)] 



(16) 



The first equality comes from applying the definition 
in Equation ([9]); the second comes from using the y- 
coordinates instead of x and rotational invariance of ki- 
netic energy and r^; finally, the third comes from apply- 
ing the definition again. Thus, if we assume a minimizing 



3 



potential V{x) exists, then C[V{Rx)] must also be mini- 
mal by rotational invariance. Moreover, if we assume the 
optimal potential to be also unique, then V{Rx) = V{x). 
Hence, by assuming existence and uniqueness, we con- 
clude the optimal potential must be a function of only 
the hyper-radius r. As we try to find the potential which 
minimizes C[V{x)], we have in the problem only the pa- 
rameters h, m, and r to construct our optimal potential. 
By dimensional analysis one is led to conjecture the solu- 
tion to be V(r) = —W „^ 2 , where is a dimensionless 
number possibly depending on S. The larger W, that 
is the more attractive the potential, the smaller the or- 
bitals and total energy, thus allowing us to save on the 
total cost without compromise. However, the attractive 
inverse square potential for W > {1 — d/2)'^ is unstable 
as it has negative infinity ground state energy, .i.e. "fall 
to the center" P-Q. Thus, the optimal potential occurs 
at the maximum allowed value of W before it collapses, 
namely 



opt 



2m 



E 



dx2 

2 



(17) 



It remains a conjecture for the rest of our paper that iJopt 
yields the smallest cost possible. 



IV. MINIMUM COST 

Since i?opt minimizes C[F(x)], by Equations © and 
T2|) . we have 



P > min I Tr pH^pt Tr pr^ } 



(18) 



To evaluate the right hand side, let us introduce k > 
and define 



(19) 



C := min Tr p ( iJopt + 77'"' 



with p subject to the entropy constraint Equation (|10p . 
The auxiliary variable n allows us to convert the cost in 
space into an energy quantity so that in a single expres- 
sion, C is the joint costs of energy and space in the form 
of a sum. As to be shown in the subsection, we have 



C>ftW— d(exp(S'/d)-l) 



(20) 



Hence, for the mixed state obtaining the minimum of the 
right hand side in Equation (I19p . we have 



TrpiJopt > Ti, &(exp {S/d) - 1) - J Trpr^, (21) 
V TO 2 



which yields 



TrpiJoptTrpr > 

^ ( h^iexp (S/d) - 1) - ^ Trpr^ ) Trpr^ 
V VTO 2 



for all non- negative values of k. Since the right hand side 
is quadratic in ^/k, at the critical k the inequality yields 

Tr piJopt Tr pr^ > ^d^ (exp (S/d) - 1)^, (22) 
Zm 

which is now free of the introduced variable k. Because 
of inequality ^TE\\ . the cost of storing information satisfies 
the bound 



P> d2(exp(5/d)-l)2, 
2to 



(23) 



which is our main result. 



A. Central Lemma 

We now proceed to prove lemma ([20)) . Simplifying the 
dimensionful quantities in C yields 



where 



C = K/TOmin Tr p_ff , 

p 



rr W 2 

2 ^ dqf 



(24) 



(25) 



is dimensionless as is q x{mK)^/^ . Let 

p = ^ft|*.>(*.| (26) 



with eigenvalues pt and ^'i orthogonal and not necessarily 
eigenstates of H . Thus, we would like to minimize 



by varying and pi subject to the entropy condi- 
tion pO|) . Obviously, we would have the smallest sum 
possible if corresponding to the highest pi we have the 
smallest \ H possible. Namely, it should be the 

ground state of H . Similarly, the next most frequently 
used ^'i should be that which yields the next least ex- 
pectation value of H . That is, it should be the first ex- 
cited state. Continuing this argument, we see that i are 
eigenstates of H with some yet to be determined distri- 
bution Pi. Optimization over pi with the constraints of 
entropy and normalization can be treated with Lagrange 
multipliers in a manner identical to that typically found 
in textbooks, thus resulting in the Boltzmann distribu- 
tion. In other words, the minimizing density matrix of 
Equation ([M]) is diagonal in the eigenstates of H with 
Pi (X exp {—(3Ei) with Ei being eigen-energies of H and 
/3 a constant depending on 5". The spectrum of H can be 
computed by casting the Laplacian into hyper-spherical 
coordinates and solving the ensuing hypergeometric dif- 
ferential equation as in Q . Eigenstates are characterized 



4 



by two quantum numbers n,l = 0,1,2,... and have en- 
ergy 



(27) 



E{n, I) = In + y^l{l + d~2), 
with degeneracy 

{d + 21 -2){d + 1-3)1 

= uid^i 

Thus, Equation (1^^ becomes 

c = h^^^ E 0)ff I) (29) 



(28) 



n=0 i=0 



where 



Z:=^^.g(0exp(-/3i?(n,Z)). 



(30) 



n=0 ;=o 



Moreover, the separation of n and I in the eigen-energy 
equation allows the partition function to be factorized 

Z = ^ cxp {-2l3n) exp {-P^Jl{l + d - 2))g{l) 



(31) 

Thus, although in Equation (j24p C in our context means 
the cost of energy and space, it can also be interpreted as 
the internal energy of a thermodynamic system composed 
of two uncoupled sub-systems n and I. Let [/„, Ui, Sn, 
and Si be internal energies and entropies of the n and I 
subsystems respectively, and we have 



C ^nj-{Un + Ui) and 
m 

Si, 



(32) 
(33) 



Because Z„, being a geometric sum, can be computed 
in closed form, we get the following exact results for the 
thermodynamic quantities 



1 / 2 
5,..,„g(l + ^)+^,„g(l + A 



(34) 
(35) 



While the n sum is trivial, we can make progress with 
the ^-sum only when making approximations in certain 
regimes. In the following we will work in the limits d 3> 1 
and /3 <C 1, which corresponds to high entropy. Using 
Stirling's formula and the method of steepest descent to 
compute the integral version of the discrete sum, we get 



Zi « 2/3- 
with the error governed by 



-d+l 



(36) 



/3 



log Zi - log 2/3-'^+! I =0[^] (Sec figure 1) (37) 
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FIG. 1: We computed logZ in two different ways for d = 
10. The log Z-plot is the result of carrying out the sum 
in Equation (|3H) to 1600 terms at which it seems stable. 
The approximation-plot is Equation (|36|l resulting from the 
method of steepest descent. The error plot shows the differ- 
ence log Z - log 2/3-'*+i , which is of the order P/d. 



By the canonical equations yielding internal energy and 
entropy from the partition function, we then obtain 



(38) 



5.H^-l)(log^ + l)+o(0 (39) 

Since we work in the regime /3 ^ 1, Equation p4p im- 
plies J7„ 3> 1. Hence, keeping only the dominant terms 
in the n-subsystem, we obtain 



5„ = log fl + ^\+0{l) 



(40) 
(41) 



When we combine the above results for the separate sub- 
systems and keep only the dominant terms, we get 



C = h\—{dUn-{d-l)+Oil/d)) and (42) 



S ^ dlogUn + O (1) , 



(43) 



We now obtain the equation relating the amount of en- 
coded information to the associated cost, 

^-h^ (exp iS/d) -^+0 (l/d^)) , (44) 
which yields lemma (PH)) in the limit of large d. 



V. CONCLUSION. 

Using non-relativistic quantum theory, we find the 
minimal physical resources needed to store information 



5 



based on a number of plausible hypotheses. Defining the 
cost in the form of a product of energy and space, we pro- 
ceed to find the interaction potential that minimizes the 
cost when storing a given amount of information. We as- 
sume such a potential exists and is rotationally invariant, 
which also follows if assuming uniqueness of the optimal 
potential. As our main result we arrive at Equation (1231) . 
which provides a lower bound to any device's energy and 
surface area when it encodes S amount of information 
in d degrees of freedom in the limits d,S ^ 1 . Accord- 
ing to our intuition we expect information to require no 
energy and space, and this only appears so because the 
factor fi/m is extremely small in the classical regime. For 
comparison with some existing rough estimates in the lit- 
erature, let us consider a spherical memory device made 
up of ordinary matter of total mass 1 kilogram and vol- 
ume 1 litter. Since the energy in our result is not the 
rest-mass energy but the excitation energies relative to 
the ground, let us take the energy to be the ionization 
energy of typical atoms, which is 10 eV. Thus, our mem- 
ory looks like a soup of many electrons at a macroscopic 
distance from a positively charged center. Our inequality 
yields S/d 20, about 20 bits per atom, which agrees 
with Bekenstein's estimate for electronic levels but falls 



far short compared to 10^ when energy is taken to be the 
rest-mass energy Q. Hence, the whole device can hold 
about 10^^ bits, which is the same as Lloyd's ultimate 
laptop, [13, Moreover, the cost is proportional to 

the number of degrees of freedom but exponential in the 
information density, S/d, thus showing analog storage 
to be much more expensive than digital. Given a device 
storing one bit of information, analog storage would keep 
the same device and use its remaining internal states to 
store additional bits, and this is shown to be exponen- 
tially more expensive than bringing in more copies of the 
same device, which is digital storage. Our current state- 
of-the-art technology stores gigabytes of information in 
a macroscopic device consisting of an Avogadro number 
of entities; that is, we are operating at the low density 
regime, S/d « 10""'^'*. As we try to create smaller de- 
vices with greater information capacity, we are pushing 
S/d to greater values. However, our result implies this 
endeavour will become infeasible due to the exponential 
scaling. 
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